Evolution in complex systems: 
record dynamics in models of spin glasses, superconductors and evolutionary ecology. 
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Recent research on the non-stationary nature of the dynamics of complex systems is reviewed 
through three specific models. The long time dynamics consists of a slow, decelerating but spasmodic 
release of generalized intrinsic strain. These events are denoted quakes. Between the quakes weak 
fluctuations occur but no essential change in properties are induced. The accumulated effect of the 
quakes, however, is to induce a direct change in the probability density functions characterising 
the system. We discuss how the log-Poisson statistics of record dynamics may be an effective 
description of the long time evolution and describe how an analysis of the times at which the quakes 
occur enables one to check the applicability of record dynamics. 

PACS numbers: 



Out of equilibrium systems are often treated as being 
in a stationary state characterised by time independent 
statistical measures. Although this is probably the case 
in some situations there are many instances where this is 
not so and where one may miss essential aspects of the 
behaviour if attempts are made to treat the phenomena 
as stationary or nearly stationary. 

Complex systems often display evolving macroscopic 
properties. The most important task of a theoretical 
treatment is then to understand the link between the 
microscopic fluctuations, which will often exhibit an ap- 
proximate time reversal symmetry and the macroscopic 
directed evolution. The description should as well ex- 
plain the nature of the emergent macroscopic dynamics. 

Here we review how the concept of record dynamics, 
developed by Sibani and Littlewood0, has successfully 
served as a paradigm for the description of the evolu- 
tion of three very different models: the relaxation of a 
spin glass following an initial temperature quench, the 
penetration of an external magnetic field into a disor- 
dered type II superconductor and a model of evolutionary 
ecology. In all three cases macroscopic variables, which 
exhibit a degree of intermittent dynamics, can be iden- 
tified. Furthermore, the sequence of transitions between 
metastable configurations can be analysed in terms of the 
record statistics. 

The work reviewed here is a result of collaboration with 
Paolo Sibani, Paul Anderson and Luis P Oliveria. Some 
details of the specifics have been published in 0. [1 0] 
The concept of record dynamics have been developed by 
Sibani and his collaborators over a long period, see e.g. 

Quail. 

Below we first introduce the models in sufficient self- 
contained detail. Next we describe how the long time 
dynamics in each case are manifestations of record dy- 
namics and discuss its consequences. 



I. THREE MODELS 

Here follows a brief description of the definition of the 
microscopic dynamics of the three models considered. 



A. Spin glass 

We consider a three dimensional Edwards- Anderson 
spin glass 



H — JijSiSj 



(1) 
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with nearest neighbour Gaussian couplings 10] and Ising 
spin Si = ±1. At time zero the temperature is instanta- 
neously dropped from infinity to a very low value. The 
subsequent dynamics is realised by use of Monte Carlo 
dynamics, see 



B. Magnetic relaxation 

We use Monte Carlo (MC) simulations of a gen- 
eralized three dimensional layered version of the Re- 
stricted Occupancy Model (ROM) model to capture 
the long time relaxation of interacting vortex matter 

The length scales of vortex interactions can be very 
large compared with the average separation between vor- 
tices. At high magnetic induction each vortex inter- 
acts with many others suggesting that a simplified coarse 
grained description in terms of vortex densities may be 
applicable. For layered superconductors it is natural to 
introduce two separate length scales: the first is the range 
of the interaction parallel to the planes, this is the Lon- 
don penetration depth A. The second length scale is the 
vortex correlation length, £||, parallel to the applied field 
(which we imagine to be perpendicular to the copper ox- 
ide planes for high temperature superconductors). The 
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exact identification of this length scale is difficult and 
is likely to depend on the anisotropy of the material, the 
nature of the pinning, the strength of the magnetic induc- 
tion and on the temperature. This len gth scale may be re- 
lated to vortex line cutting[Il d, [UllS, [H HHlllH . 
These length scales respectively give the horizontal, lo, 
and vertical, l\, coarse-graining length and therefore the 
lattice spacing of our model. Horizontally we have Iq = X 
and perpendicularly l\ ~ £|| ■ Smaller length scales are ig- 
nored. For our purposes this approximation is acceptable 
because the length scales smaller than A seem to have lit- 
tle influence on the long time glassy properties of vortex 
matter. 

The behaviour of vortex matter is determined by the 
competition of four energy scales |25j : intra and inter- 
layer vortex-vortex interaction, vortex-pinning interac- 
tion and thermal fluctuations, all of which are schemati- 
cally included in the ROM model. 

The Hamiltonian of the ROM model is thus the follow- 
ing: 

H = A i jn i n j - J ^2 Aurii+^2 A?n i + J ^2 A2 (n* - Hj) , 

ij 1 i (ij) z 

.(2) 

where rii is the number of vortices on site i of the lattice. 
In a superconducting sample the number of vortex lines 
per unit area is restricted by the upper critical field {B C 2) 
[26j, so in the model the number of vortices per cell can 
only assume values smaller than N c % — -B C 2^o/0o [HHI3- 
Hence the name Restricted Occupancy Model. Moreover, 
as we are interested in a simulation setup that does not 
require magnetic field inversion and the vortex-antivortex 
creation is strongly suppressed, we simply consider m > 
0. 

The first two terms in Eq. J2J) represent the repul- 
sion energy due to vortex-vortex interaction in the same 
layer, and the vortex self energy respectively. Since the 
potential that mediates this interaction decays exponen- 
tially at distances longer than our coarse-graining length 
A, interactions beyond nearest neighbours are neglected. 
We set An := Aq = 1, Ay := A\ if i and j are nearest 
neighbours on the same layer, and Ay := otherwise. 

The third term represents the interaction of the vortex 
pancakes with the pinning centres. A\ is a random poten- 
tial and for simplicity we consider that A\ has the follow- 
ing distribution P (Af ) = (1 - p) S (Af) - P S (Af - A p ). 
The pinning strength |Aq| represents the total action of 
the pinning centres located on a site. In the present work 
we use \Aq\ = 0.3. 

Finally the last term describes the interactions between 
the vortex sections in different layers. This term is a 
nearest neighbour quadratic interaction along the z axis, 
so that the number of vortices in neighbouring cells along 
the z direction tends to be the same. 

The parameters of the model are defined in units of 
Aq. The time is measured in units of full MC sweeps. 
The relationship between the model parameters and ma- 
terial parameters is discussed in [Til |27| . The model has 



been demonstrated to reproduce a very broad range of 
experimental observations including dynamical aspects of 
magnetic creep and memory and rejuvenation of voltage- 
current characteristics [H 111 El El E! El HI 

Each individual MC update involves the movement to 
a neighbour site of a single randomly selected vortex. The 
movement of the vortex is automatically accepted if the 
energy of the system decreases; if the energy of the sys- 
tem increases, the movement is accepted with probability 
exp(-A£;/T) H|. 

The external magnetic field is modelled by the edge 
sites on each of the planes. The density at the edge is kept 
at a controlled value. During a MC sweep vortices may 
move between the bulk sites and the edge sites. After 
each MC sweep the density on the edge sites is brought to 
the desired value. Initially the external field is increased 
to a desired value (N ext = 10 vortices per edge site) by a 
very rapid increase in the density on the edge sites. 

After this fast initial ramping the external field is kept 
constant, while we study how the vortices move into the 
sample. The age of the system, t w , is taken to be the 
time since the initial ramping. 



C. Tangled Nature 

D. Definition of the model 

The Tangled Nature model is an individual based 
model of evolutionary ecology. We give a brief outline of 
the model here. Details can be found in [2l l30ll3i| . An in- 
dividual is represented by a vector S" = (5f , S% , —,Sl) 
in the genotype space S, where the "genes" 5f may 
take the values ±1, i.e. S Q denotes a corner of the L- 
dimensional hypercube. In the present paper we take 
L = 20 as this gives space of a reasonable size to explore 
(over a million genotypes) whilst not being computation- 
ally prohibitive. We think of the genotype space S as 
containing all possible ways of combining the genes into 
genome sequences. Many sequences may not correspond 
to viable organisms. The viability of a genotype is de- 
termined by the evolutionary dynamics. All possible se- 
quences are made available for evolution to select from. 
The number of occupied sites is referred to as the diver- 
sity, here analogous to the number of species or species 
richness |32|. As explained later, genotype, species, site 
and node are synonymous throughout. 

For simplicity, an individual is removed from the sys- 
tem with a constant probability pkui per time step. A 
time step consists of one annihilation attempt followed 
by one reproduction attempt. One generation consists of 
N(t)/pkiii time steps, which is the average time taken to 
kill all currently living individuals. All references to time 
will be in units of generational time. 

The ability of an individual to reproduce is controlled 
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by a weight function H(S a ,t): 



H(S a ,t) = 



-fiN(t), (3) 



where c is a control parameter, N(t) is the total number 
of individuals at time t, the sum is over the 2 L loca- 
tions in S and n(S,t) is the number of individuals (or 
occupancy) at position S. Two positions S a and S b in 
genome space are coupled with the fixed random strength 
J ab — J(S°, S & ) which can be either positive, negative or 
zero. This link is non-zero with probability 0, i.e. 8 is 
simply the probability that any two sites are interacting. 
To study the effects of interactions between species, we 
exclude self- interaction so that J aa = 0. 

The conditions of the physical environment are sim- 
plistically described by the term fiN(t) in equation J2J), 
where ji determines the average sustainable total popu- 
lation size, i.e. the carrying capacity of the environment. 
An increase in fi corresponds to harsher physical condi- 
tions. Notice that genotypes only adapt to each other 
and the physical environment represented by [i. We use 
asexual reproduction consisting of one individual being 
replaced by two copies mimicking the process of binary 
fission seen in bacteria. Successful reproduction occurs 
with a probability per unit time given by 



Poff(S a ,t) 



exp[g(SV)] 
H-exp[JT(S«V)] 



G[0,1]. 



(4) 



This function is chosen for convenience. We simply need 
a smoothly varying function that maps H(S a ,t) to the 
interval [0, 1] and it is otherwise arbitrary. We allow for 
mutations in the following way: with probability p mu t 
per gene we perform a change of sign Sf — > —Sf during 
reproduction. 

Initially, we place 2V(0) = 500 individuals at randomly 
chosen positions. Their initial location in genotype space 
does not affect the nature of the dynamics. A two- phase 
switching dynamic is seen consisting of long periods of 
relatively stable configurations (quasi-Evolutionary Sta- 
ble Strategies or q-ESSs) interrupted by brief spells of 
reorganisation of occupancy which are terminated when 
a new q-ESS is found, as discussed in |30| . 



II. RECORD DYNAMICS AND ITS 
MANIFESTATION 

In this section we review the macroscopic intermittent 
dynamics of the three models and show that in all cases 
record dynamics is an efficient description of the statis- 
tical aspects of the temporal evolution. Before that we 
need to sketch the notion of record statistics. 

Let x(t) denote an uncorrelated stochastic signal 
distributed according to the probability density func- 
tion(pdf) p(x)- By the record of the signal we mean 
R(t) — max{x(i')|i' < t}. Obviously R(t) is a piece- 
wise constant function which jumps discontinuously as a 



fluctuation manages to take x(t) to a new record value. 
The times tk at which this happens are called the record 
times. It was pointed out be Sibani and Littlewood|33| 
that the probability that exactly q records occure during 
a time interval [t w ,t w + t] is to a good approximation 
given by 



P(q) = -^-exp{-(g)}, 



(5) 



where (q) — alog(l + t/t w ). This is a Poisson distribu- 
tion in the logarithm of time. For a mathematical process 
the logarithmic rate a = 1. Here we include the possi- 
bility a / 1, which may happen for a physical process 
as an effect of over or undercounting of the true number 
of records. For example a > 1 can occur if the recorded 
record times are produced by more than a single inde- 
pendent record process. In contrast a < 1 can e.g. be 
an effect of not being able resolve all the record events of 
record process. The average number of records per time 
unit decreases inversely proportional with time, namely 



d{q)_ 
dt 



(6) 



It is important to note that Eqs. J5j and (JSJ) are indepen- 
dent of p(x)- Thus the statistical properties of a record 
signal R(t) are very general and do not depend on the 
properties of the underlying fluctuating signal xW- 



A. Spin-glass 

After an initial quench from very high temperature it 
is natural that the dynamics of the spin glass leads to 
a relaxation towards ever lower energy. The specifics of 
how this happens was analysed in great detail by Sibani 
and collaborators for the Edwards- Anderson spin 
glass. They followed the temporal evolution of the to- 
tal energy E{t) given in Eq. lP They identified the 
sequence of local minima E m i n (k) and local maxima 
E m ax{k) from which they defined the fc-th barrier as 
AEk — E m ax(k) — E m in(k) . The set of barriers turn out 
to be monotonously increasing AEk < AJ5fc+i, but only 
marginally so in the sense that AEk — Afifc+i. Thus to 
exit the fc-th metastable state visited by the spin glass, 
a barrier slightly larger than any encountered previously 
has to be overcome. The set of time instances at which 
the spin glass manage to move from one metastable con- 
figuration, i.e. the quake times tk, was found to follow the 
log-Poisson distributed characteristic of record statistics, 
see E.q. |J5}. 



B. Magnetic relaxation 

The magnetic pressure exerted by the external mag- 
netic field in the ROM model introduced above will force 



4 



ROM 



Tangled Nature 




FIG. 1: Time dependence of the ROM and the Tangled Na- 
ture model 



the number of vortices in the bulk, N v (t), of the sam- 
ple to increase with time. We have found that N v (t) is 
essentially a record signal^, HI, see Fig. ^ 

The sequence of record times follow to good approxi- 
mation the statistics derivable from Eq. (0 expected for 
an uncorrelated record signal 2]. 



C. Evolutionary Ecology 

That directedness of the temporal evolution of the 
quenched spin glass and also of the superconductor in 
an external field is to be expected. It is less obvious why 
the Tangled Nature model of biological evolution exhibit 
a gradual adaptation towards more stable configurations. 
The diffusive nature of the dynamics in genotype space 
may suggest the breaking of time reversal symmetry. But 
this in itself doesn't point to a reason why the total num- 
ber of individuals in the model is increasing, on average, 
with time. Nor does diffusion imply that the configura- 
tions tend to be come more stable with time. 

The following analysis suggests an explanation. First 
assume that no mutations can occur. The population dy- 
namics is controlled by the fixed probability pkm and the 
offspring probability Poff- Fluctuations in the popula- 
tion size N(t) will lead to fluctuations in p ff according 
to Eq. (|3J). The overall stability of the population is 
ensured since the fixpoint condition p ff = Pkill is sta- 
ble. This follows because an increase in N(t) will lead 
to a decrease in H (see Eq. © and therefore in p ff- 
Similarly a decrease in N(t) leads to a increase in H . 
Now consider the effect of mutations. The evolutionary 
dynamics is driven by the mutations which move individ- 
uals between positions in genotype space. These muta- 
tions are random and lead to symmetric fluctuations in 
the weight function H as an effect of changing the cou- 



pling term H, see Eq. @. Let us schematically write H 
as H = J — fiN. Mutations induce fluctuations of the 
form J i— ► J + 8J. Assume 5 J > and that the same 
fluctuation with opposite sign — 5 J occurs with equal 
probability. The mutation leading to bj is, however, 
more likely to become established since 



Poff (h + 6J)> Poff (H-5J), 



(7) 



for values of H where p f / is convex; which is the case 
for p ff < 1/2 according to Eq. @. This is a mathe- 
matical way of paraphrasing Darwin's description of how 
favourable variations become entrenched |34|. 

It was found from simulations of the Tangled Nature 
model that N(t) gradually increases. Furthermore, the 
configurations occupied in genot ype space becomes, on 
average, more stable with time0,|31|. In Fig. [T\wc com- 
pare the record signal derive from N(t) with N(t). It is 
clear that there are much larger deviations between the 
record and the signal itself, than was the case in the ROM 
model. Nevertheless, we do believe that the statistics of 
the record times obtained from the record signal derive 
from N(t) essentially corresponds to the transition times 
between the q-ESS epochs. 



III. CONSEQUENCES 

We briefly review some of the most prominent conse- 
quences, which may be derived from the record dynamics. 



A. Spin glasses 

A detailed description of how certain aspect of inter- 
mittency, aging and memory in spin glasses can be con- 
sidered a consequence of record dynamics was given in 
0,0. That the fluctuations clearly separates into 'quake' 
fluctuations and Gaussian equilibrium like fluctuations 
show up directly in a study of the heat exchange be- 
tween the spin glass and its thermal bath. The pdf for 
the heat exchange consists of a Gaussian part and an ex- 
ponential tail. The exponential tail is produced by the 
large releases of energy that occur when a quake takes the 
spin glass from one metastable state to the next. The ex- 
ponential tail is only visible when the heat exchange is 
collected during a time interval, St that is short compare 
to the time t w passed since the initial quench from high 
temperature. Recall that the quake activity decreases 
roughly inversely proportional with time. If St 3> t w 
there is not enough quake activity during the sampling 
time 8 to make the exponential tail of the pdf visible 
though peak of the much more frequent Gaussian fluctu- 
ations. In this way the one point distribution of the heat 
exchange is able to probe the aging of the spin glass 3 . 

Aspects of memory and rejuvenation in a tempera- 
ture shift experiment can also be related to the record 
dynamics^. Let b(t w ,T) denote the largest energy bar- 
rier overcome by the quakes during the time t w since the 
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initial quench. This barrier will, according to the Ar- 
rhenius law, determine the rate of quake activity, r q at 
times about t w . On the other hand, from the view point 
of record dynamics, we also have r q (T) ex l/t w . A drop 
in the temperature T \— > T' at t w will not change the 
barrier b(t w , T) established by the record dynamics prior 
to t w . The Arrhenius activation of the quakes will how- 
ever drop when the temperature is lowered producing an 
effective age of the system oc l/r q (T') > t w . It is in- 
teresting to note that the effect of the temperature drop 
has two opposite effects concerning the apparent age of 
the system: (a) the drop in T make the energy barriers 
look bigger. So in this respect the spin glass appears to 
be older, (b) The amount of energy delivered to the heat 
bath during a quake is higher and in this respect the spin 
glass appears younger. A detailed discussion is given in 
Ref. jf. 

B. Magnetic relaxation 

We now explain how record dynamics might explain 
the observation that the rate of thermally activated creep 
is found to be essentially temperature independent for 
broad ranges of the temperature We described in sec- 
tion ^B] and ^TO] that, in the ROM model, the temporal 
evolution of the total number of vortices in the bulk of 
the sample is a record signal. A prominent feature of 
the record time of an uncorrelated stochastic process is 
that the statistics of the records, and in particular the 
rate with which the records occur, is independent of the 
properties of the underlying stochastic process. For the 
specific case of thermally induced fluctuations this im- 
plies that the rate of the record will be temperature in- 
dependent. In Fig. |21 we show that the temperature 
dependence of the ROM model compare well with exper- 
imental creep rates. Both exhibit a broad range of weak 
temperature dependence. Details can be found in 5] 

C. Biological evolution 

In figure n we showed that the total population size of 
the Tangled Nature model, despite of large fluctuations, 
may also be related to record dynamics. The nature of 
the metastable states between the quakes is in this case 
difficult to determine. But we believe they are closely re- 
lated to the quasi-Evolutionary Stable Strategies which 
have been identified in the model|3(j. We have found 
that the number of extinctions and creation events per 
time decreases in the Tangled Nature model l3ll. Sim- 
ilar behaviour is observed in macro-evolution 37J . The 
dynamics of the Tangled Nature model is intermittent 
as is to some extend clear from Fig. ^ The intermit- 
tency is, however, much more evident from analysis of the 
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FIG. 2: Main panel: Numerical results for the creep rate ver- 
sus temperature. Details in p|. Insets: experimental results 
for the creep rate versus T. The right inset shows data from 
Keller el al. for melt processed YBCO crystals with the mag- 
netic field applied along the c axis (squares) and ab plane 
(circles). The left inset shows data from |35|| for unirradiated 
(squares) and 3 MeV proton- irradiated (circles) YBCO flux 
grown |3ql crystals with a 1 T magnetic Field applied parallel 
to the c axis. 



comparing the Tangled Nature model and the dynamics 
of the fossil record we are able to suggest that the decreas- 
ing extinction rate and the intermittcncy, or punctuated 
equilibrium, is a result a hitherto unrevealed record dy- 
namic that somehow controls the macro-dynamics of bi- 
ological evolution. 



IV. SUMMARY AND CONCLUSIONS 

The relevance of record dynamics to the long time evo- 
lution of complex systems was indicated by reviewing 
three very different model studies. The most prominent 
characteristics of record dynamics are log-Poisson distri- 
bution of the number of records, or quakes, occurring 
during a time interval and a rate of events, which de- 
creases inversely proportional with time. It will be very 
interesting to analyse the dynamics of other complex sys- 
tems from the view point of record statistics. The analy- 
sis requires access to the time instances at which quakes 
occur. If that is not available analysis of the probability 
density function of a single fluctuating quantity such as 
the heat exchange of a spin glass may suffice to reveal 
the existence of an underlying record dynamics. 
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